Dependency-based Evaluation of Minipar
نویسندگان
چکیده
In this paper, we first present a dependency-based method for parser evaluation. We then use the method to evaluate a broad-coverage parser, called MINIPAR, with the SUSANNE corpus. The method allows us to evaluate not only the overall performance of the parser, but also its performance with respect to different grammatical relationships and phenomena. The evaluation results show that MINIPAR is able to cover about 79% of the dependency relationships in the SUSANNE corpus with about 89% precision.
منابع مشابه
Performance of Stanford and Minipar Parser on Biomedical Texts
In this paper, the performance of two dependency parsers, namely Stanford and Minipar, on biomedical texts has been reported. The performance of the parsers to assign dependencies between two biomedical concepts that are already proved to be connected is not satisfying. Both Stanford and Minipar, being statistical parsers, fail to assign dependency relation between two connected concepts if the...
متن کاملDetecting Entailment Using an Extended Implementation of the Basic Elements Overlap Metric
In this paper we evaluate the utility of the recently proposed Basic Elements (BE) summarisation evaluation metric as a means of detecting entailment in a text/hypothesis sentence pair. Basic Elements are tuples representing important syntactic chunks in the Minipar dependency parse of a sentence. We extend the BE matching function with additional semantic knowledge, and show that both the basi...
متن کاملDLSITE-2: Semantic Similarity Based on Syntactic Dependency Trees Applied to Textual Entailment
In this paper we attempt to deduce textual entailment based on syntactic dependency trees of a given text-hypothesis pair. The goals of this project are to provide an accurate and fast system, which we have called DLSITE-2, that can be applied in software systems that require a near-realtime interaction with the user. To accomplish this we use MINIPAR to parse the phrases and construct their co...
متن کاملGenerating Typed Dependency Parses from Phrase Structure Parses
This paper describes a system for extracting typed dependency parses of English sentences from phrase structure parses. In order to capture inherent relations occurring in corpus texts that can be critical in real-world applications, many NP relations are included in the set of grammatical relations used. We provide a comparison of our system with Minipar and the Link parser. The typed dependen...
متن کاملA Study on Effectiveness of Syntactic Relationship in Dependence Retrieval Model
To relax the Term Independence Assumption, Term Dependency is introduced and it has improved retrieval precision dramatically. There are two kinds of term dependencies, one is defined by term proximity, and the other is defined by linguistic dependencies. In this paper, we take a comparative study to re-examine these two kinds of term dependencies in dependence language model framework. Syntact...
متن کاملذخیره در منابع من
با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید
عنوان ژورنال:
دوره شماره
صفحات -
تاریخ انتشار 2002